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[57] ABSTRACT 

A conventional digital panoramic radiographic unit includes 
sonic or optical three dimensional scanning detector and a 
color video detector so that when the panoramic x-ray data 
is obtained, three dimensional contour of the surface of the 
patient's skin and the outward visual appearance of the 
patient's skin are also obtained as correlated data sets. The 
correlated data sets are then stored within a computer system 
as three sets of simultaneously or near simultaneously taken 
correlated data. The correlated data is then deconvolved to 
form a two-dimensional image of the tooth and jaw structure 
of patient as correlated to the patient's jaw and Up contours 
and visual appearance from a selected viewpoint. 

15 Claims, 3 Drawing Sheets 
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SCANNING DEVICE OR METHODOLOGY 
TO PRODUCE AN IMAGE INCORPORATING 
CORRELATED SUPERFICIAL, THREE 
DIMENSIONAL SURFACE AND X-RAY 
IMAGES AND MEASUREMENTS OF AN 
OBJECT 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The invention relates to the field of measurement and 
visualization of the superficial surface appearance, three 
dimensional contour and subsurface structure of an object, 
and in particular to improvements in orthodontics and oral 
surgery in measuring and visualizing anatomical landmarks 
used in orthodontic analysis by direct measurement of the 
face, head and jaws of a subject to produce correlated video, 
laser and x-ray derived measured images and to topologi- 
cally transform the same to hypothetical modifications for 
visualization. 

2. Description of the Prior Art 

The apparatus for generating cephalometric tracings 
directly from a patient by generating digitized two or three 
dimensional data from a patient's head from defined loca- 
tions of preselected landmarks is well known and is based on 
the use of optical or sonic marking using three dimensional 
triangulation. For example, such an apparatus is shown and 
described in Lemchen, et al. "Method and Apparatus for 
Generating Cephalometric Images" U.S. Pat. No. 5,278, 
756 (1994) in which a means for defining a position with 
respect to a given anatomical reference is provided by a 
probe having a tip which generates signals of a certain 
optical or sonic frequency, when activated when positioned 
at selected reference points on the head or jaw. Triangulation 
detectors receive the position indicating signals from the 
probe and a computer processes the received signals to 
provide digital data corresponding to the three dimensional 
location of the probe tip with reference to the head or jaw. 
A visual image of the head or jaw is displayed as seen from 
a chosen direction or directions with a video camera. The 
video image is displayed together with a cephalometric 
tracing as would be seen in the same direction and scale 
which tracing is derived by joining appropriate anatomical 
landmarks with tracing lines generated by the computer 
according to any one of a number of accepted tracing 
techniques. 

Lateral cephalograms using x-ray exposures are also well 
known from conventional orthodontic diagnosis. One prior 
art system for computer generating lateral cephalometric 
tracings is described in Ricketts, et al., "Orthodontic Diag- 
nosis and Planning" as published by Rocky Mountain 
Orthodontics of Denver, Colo. (1982). 

Panoramic radiography is also well established and has 
recently been commercialized to create digitized x-ray pano- 
graphs as, for example, as provided by the system sold under 
the trademark, Siemens SIDEXIS, as manufactured by Pel- 
ton & Crane of Charlotte, N.C. Digitized x-ray signals are 
received directly from the panographic exposure and real 
time processing enables immediate display of the x-ray 
images on a monitor. 

However, the panographic gantry and exposure equip- 
ment operates solely in connection with a single x-ray 
exposure and image. The laser optical or sonic equipment 
described in U.S. Pat. No. 5,278,756 also operates solely in 
relationship to a single detection and imaging system. The 
data from the separate x-ray panograph and the optical or 
sonic cephalometric trace can be downloaded into a single 
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computer and through nontrivial and substantial computing 
effort with some degree of programming skill, the two sets 
of data can be correlated after the fact. However, such an 
approach requires multiple exposure apparatus, and consid- 

5 erable time and computer operator skill in order to obtain 
usefully correlated x-ray and laser images. 

Marks, "Combined Imaging Scanner" U.S. Pat. No, 
5391,877 (1995) describes an image scanner that combines 
images obtained from two systems that are supported on a 

10 combined gantry. The Single Photon Emission Computed 
Tomographic (SPECT) Scanner includes a gantry support- 
ing a computed tomographic (CT) Scanner 12. The gantry 
also supports the SPECT Scanner 14. The single table 16 
supporting the patient's position sequentially pass through 

!5 both gantries. Initially the CT data is obtained and then the 
SPECT data. The single computer 18 mathematically con- 
volves the two image data sets. The CT data is processed to 
provide a background or map on which to superimpose the 
SPECT data. As The CT anatomical data is convolved with 

20 the SPECT radioisotope distribution data to provide a color- 
shaded relief image. A single computer 18 is used for the 
analysis. The information is displayed on a machine control 
display 20, a raw CT display terminal 22, and a raw SPECT 
display terminal 24 and a combined CSPECT display ter- 

2s minal 26. Image on the display terminal 26 can be printed to 
a color laser printer 28. 

Wessels, "Alignment System to Overlay Abdominal Com- 
puter Aided Tomography and Magnetic Resonance Anatomy 
With Single Photon Emissions Tomography" U.S. Pat. No. 

30 5,299,253 (1994) describes a system comprised of machine- 
base support means: (a) with a contrasting marker means (b) 
attached to the support for providing a set of markings which 
uniquely identifies a cross-section of an imaged object. The 
support means includes material encasement, and means to 

35 encapsulate the contrasting markers in an inert material. The 
material for the encasement may be polymer, wood, foam, 
metal, ceramic or a combination of these materials which do 
not otherwise interfere with the imaging system. Contrasting 
marker (b) is a mark whose outline can be accurately viewed 

40 without distortion or blurring within the image system being 
used. The marker can have many shapes including that of a 
solid or hollow tube. The contrast agent in the marker is a 
solid, liquid or gas which is readily discernible with a 
particular type of imaging system used. The pattern of 

45 contrast markers must be such that there is at least one 
transversely constant contrast marker and at least one trans- 
versely variable contrast marker spanning the longitudinal 
and imaging area. The alignment system can be used in one 
plane, or there can be a series of alignment systems in planes 

50 above the object to be imaged. In use, for registering single 
photon emission tomography images with computer tomog- 
raphy or magnetic resonance images, the object to be imaged 
placed on a support means. The support means can be a 
partial cast of the object's external shape. At least a portion 

55 of the object is adjacent to a contrast marker means. The 
object is imaged using two or more imaging techniques. At 
least two images of the object are registered to produce a 
coherent image of the object. 

Mohr, et al., "System and Method For Using A Dual 

60 Modality Detector For Inspecting Objects" U.S. Pat. No, 
5,519,225 (1996) describes an industrial inspection system 
using a dual modality gas ionization detector with beams of 
either neutrons or photons from X-rays or gamma rays 
passing through the object. A dual modality gas ionization 

65 detector 10 has a window 16 for transmitting X-rays or 
gamma rays. The windows is made of a material which is 
permeable to these types of radiation. The detector includes 
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a housing 12 that has an ionization chamber 18 filled with BRIEF SUMMARY OF THE INVENTION 

high pressure gases such as helium or Xe, which chamber 18 _ . ... 

is used to detect the neutron, x-ray or gamma rays fluxes . ^ «™ntion » « i apparatus for simultaneously provid- 

incident on the ionization detector. lD 8 multl P^ ^ °[ ™asured data fiom a patient com- 

_ . , , c pnsing a plurality of scanning devices for providing the 

The inspection system is used to detect the presence of 5 muhi fc ^ of me ^ UIcd data from the tient> and a 

n.tnde and titanium sponge nuggetsor residual core material m which thc , urali of devices 

in hollow-cast turbine engine blades. Mohr was cited for afc mounted „ leas , m for scannin lhe , jent A 

showing the simultaneous irradiation of objects with two , er m Qr workstation correlates , ne out , from 

types of radiation and the simultaneous and alternating each of the mulli le sca|mi devices , Q ovide „ leas , a 

detection of the same^ The structure of the Mohr device 10 ^ rf ^ * t ^ ^ 

uicludes a collimator 20 comprised of two bars 22 and 24 ^ mcasure da(a of , he muh; , e scans are to each 

define a slit 26 between them which colhmates the beams ^ 

entering the chamber into a thinner beam. The beams . ', .„ . ,. 

entering the chamber interact with gases to produce a D lhe ^ustrated embodiment the scanning .gantry rotates 

secondary-ionization charge that has accelerated toward at least m part about a portion of interest of the patient. The 

electrodes 28. A single layer of nuggets 34 on conveyor belt scanning gantry rotates about the hps, teeth and jaw str^c- 

40 are imaged by moving past a dual radiation source 42, mrc ot the P aUent * 

which alternately pulses neutrons and X-rays or gamma rays plurality of scanning devices includes an x-ray expo- 

at the nuggets. The dual modality gas ionization detector 10 sure device, such as a panoramic x-ray exposure device or 

measures the transmissivity of the alternating radiation 20 a teleradiography x-ray exposure device, 

passing through the nuggets and supplies a signal to image The plurality of scanning devices also includes a video 

generator 46. Image generator 46 includes an analog digital imaging device, and preferably a color video imaging 

converter 48, processing means 50 and an image display device. 

device 52. The plurality of scanning devices still further includes a 

Dumoulin, et al. f "Stereoscopic X-Ray Fluoroscopy Sys- 25 three dimensional scanning device. 

tern using Radiofrequency Fields" U.S. Pat. No. 5,251,635 i n the preferred embodiment each of the plurality of 

(1993). The system is directed to minimizing an X-ray dose scanning devices acquires data simultaneously and simulta- 

while still providing a stereoscopic tracking image of an neously stores the multiple data in the computer system as 

invasive device in a patient. FIG. 1 shows a patient 112 ^ correlated data. It is also contemplated that the plurality of 

positioned in the X-ray imaging system. The system pro- scanning devices acquire data in sequence doing a single 

vides a stereoscopic view of the patient with the X-ray image exposure session of the patient and stores the sequentially 

being only occasioned updated. The computer system tracks acquired data as correlated within the computer system, 

the invasive device and provides a superimposed image of Iq particular , lhc plurality of seeing dcv ices acquires 

the evasive device with the position being updated at a high tooth and • stmcturc data ^ fl fet scanning devicc> thrcc 

rate. The invasive device has a transmitter coil that transmits dimcnsional cootour data through a sccond scaiming dcvicc 

an RF signal to a plurality receiving coils placed around the and supcrficial surfacc data lhrough a third sc^g dev ice. 

patient, Tne tracking computer calculates the position and Tfac samc scaQning dcvicc may morc tnan onc of tnc 

orientation of the invasive device and supplies the image daU ^ ^ dcsifcd ^ {QO{h and jaw structurc> threc 

superpositioned on the last X-ray image. The tracking sys- dimcnsional contour data superficial surface data are 

tern can be used with other imaging systems such as mag- correlatcd by the computer system to provide a composite 

netic resonant scanners, ultra sound scanners, positron image thereof 

emission, tomography scanners and the like. . ' . 

„ , . , w. a » Th e mvention is also a method of creating correlated 

Suckewer, et toer Microscope Apparatus, { { X f { , ^ structure ^ 

US. Pat. No. 4,979,203 (1990) describes an X-ray contact 4J co J nT ^ {Q ^ a e comprising imaging a 

microscope and [optical phase contrast microscopic system. bQne ^ ^ ^ ^ &mhcQ . 

Object cells 22 have been cultured on an X-ray res*t surface Qf a ^ b mulli le scans of lhe same ^ 

46. An inverted microscope 26 using light source 34 is used ^ surface . bQ ^ ^ and ^ sk(n SUffaoe 

tc .position the object cells for ^K^ioau&X^aybeam comour use of tnree dimensional display 

30from an x-ray lasersour^ 5Q f ntation desired sucn „ mesn nel ima mnmi 

66 is provided to monitor fluorescent effects of the object. ^ Qf shading ^ mmp{t ^ of corre , ated daU afe 

None of the prior art references show a multiple scanning simultaneously displayed to produce a composite image. 

exposure system for dental application in which the dental r™ . *♦ u • uu-n • j 

v r . J , j j ** • . . . The invention having now been briefly summarized, can 

X-ray is separately created and combined with video and . . lt .. . . . ..urn • -i 

, , _ it- . be better visualized by turning to the following drawings 

laser scanning of a patient s face or jaw structure. „ . . ,., , ' c ° . . ,., ° , ° 

& r J " wherein like elements are referenced by luce numerals. 
None of the systems are concerned with combinations 

which would combine surface data, and in particular, facial BRIEF DESCRIPTION OF THE DRAWINGS 
surface data, with underlying bone structural data derived 

from X-ray scans. The correlation between underlying bony FIG. 1 is a side perspective view of a digital dental 

structure and outward superficial tissues is a correlation 60 topography panoramic device which includes x-ray 

which is qualitatively and conceptually different than cor- scanning, laser or sonic cephalometric tracing and video 

relation or alignment between different scans of the same imaging in a single real time mechanism, 

internal structure. FIG. 2 is a depiction of utilization of the device of FIG. 

What is needed is some type of apparatus and methodol- 1 in which the anatomical landmarks are being optically or 

ogy whereby multiple scanned cephalometric or dental 65 sonically marked. 

images can be conveniently, economically and quickly com- FIG. 3 is a perspective depiction of a video image of the 

bined for usefully correlated result. surface of a patient taken with the device of FIGS. 1 and 2. 
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FIG. 4 is a panographic x-ray of the teeth and jaw bone or later devised to create any desired dental or orthodontic 

of a patient taken in the device of FIGS. 1 and 2. images and is not just moving direction images like pan- 

FIG. 5 is a laser contour of the anatomical landmarks of oramic radiographs or fixed direction images like teleradio- 

the patient taken in the device of FIGS. 1 and 2. graphs. The teleoradiographic unit 30 is depicted in the 

FIG. 6 is a superposition of the three scans depicted in * Perspective view of FIG. 2. Different radiographic programs 

FIGS. 3, 4 and sTatai in real time in the device of FIGS. !^ " I* wtn.t » V < 

1 . * apparatus and methodology of the invention, again without 

limitation to what is illustrated here. For example, 16 

FIG. 7 is a block diagram of the invention which shows different radiographic programs for diagnosis of the jaw 

an X-ray exposure and detection system carried by gantry region of patient 20 are conventionally included within the 

with a three dimensional contours scanning system and a panoramic videographic apparatus 10 in the SIDEXIS sys- 

surface image scanning system. tem. However, it is expressly understood that the invention 

The invention and its various embodiments, now having is not limited by the modalities of operation of panoramic 

been briefly summarized and visually depicted in the fore- radiographic devices currently available or as made later 

going drawings, can be understood by turning to the fol- J5 available, but includes within its scope any type of digitized 

lowing detailed description. x-ray diagnostic equipment. 

DETAILED DESCRIPTION OF THE At the t " ne l ^ al lhe P ano S ra P mc radiograph of 

PREFERRED EMBODIMENTS p * tienl 20 * laken ^ 10 ' video cam , era 18 

of apparatus 10 also is taking a real time corresponding or 

A conventional digital panoramic radiographic unit 2Q correlated video image of the patient's face and in particular, 

includes sonic or optical three dimensional scanning detec- that portion of the head relating to the patient's lips and jaw 

tor and a color video detector so that when the panoramic structure or teeth. The video imaging system may be of the 

x-ray data is obtained, three dimensional contour of the type shown in U.S. Pat. No. 5,278,756, which is incorpo- 

surface of the patient's skin and the outward visual appear- ra ted herein by reference, or may be any type of imaging 

anceof the patient's skin are also obtained as correlated data 25 system now known or later devised which can provide a 

sets. The correlated data sets are then stored within a digitized or digitizable image of the surface of the patient's 

computer system as three sets of simultaneously or near head, face, jaw and/or lips, and teeth, 

simultaneously taken correlated data. The correlated data is i n the preferred embodiment the three dimensional color 

then deconvolved to form a two-dimensional image of the scanning system of Cyberware of Monterey, Calif., is used 

tooth and jaw structure of patient as correlated to the 3Q to provide both the superficial color image of the face, j aw, 

patient's jaw and lip contours and visual appearance from a ^ a[ld tccthf and the thrce dimensional contours of the 

selected viewpoint. Additional scans may be added as cor- f acc , j aw> ii ps anc j teet h. The dentist or oral surgeon is thus 

related data sets, such as three-dimensional surface scans of aD i c to work with true human faces by obtaining images as 

the teeth for orthodontic purposes. littlo as 12 seconds. The Cyberware Model WB4 whole- 

FIG. 1 is perspective side view of the apparatus, generally 35 body scanner allows capture of the shape and color of the 

denoted by reference numeral 10, which is a device for entire human body. To capture the intricacies of the human 

providing panoramic dental digital tomography in a manner body in one pass, the scanner uses one or more scanning 

similar to digital radiology devices such as sold under the instruments mounted in apparatus 10. A linear ball-bearing 

trademark, Siemens SIDEXIS, by Pelton and Crane of rail and servo motor assembly may be used to move the 

Charlotte, N.C. Apparatus 10 is comprised generally of a 40 scanning instrument in the desired directions or the rotating 

console 12 which includes a computer 14 to which is gantry of the SIDEXIS may be employed. The use of 

connected a monitor 16 and video camera 18. Console 12 multiple scanning instruments improves accuracy on the 

also includes an x-ray source and control circuitry for the sides of the face or body and in difficult-to-reach areas. The 

x-ray source (not shown) for the purpose of providing a WB4 scans a cylindrical volume 2 meters (79 inches) high 

controlled x-ray exposure of a patient 20 positioned within 45 with a diameter of 1.2 meters (47 inches). These dimensions 

a panoramic gantry 22. The patient's head is maintained accommodate the vast majority of human subjects. For even 

stationary at a fixed position by means of a head brace 24 larger subjects, available zippering software enables two or 

and the jaw is maintained in a fixed partially part separation more scans to be quickly combined into a complete three 

by means of a jaw bite fixture 26. A rotating detector 28 dimensional color model. 

rotates about the patient 's head to obtain a digitized real time 50 The scanner is controlled via Cyberware software running 

x-ray topographic image of the patient's teeth and jawbone on a Silicon Graphics workstation. Cables connect each 

structure. scanning instrument to a SCSI controller unit and a power 

It must be clearly understood that the configuration of the supply unit. The SCSI controllers connect to the 

device shown in FIG. 1 is only illustrative and is not limiting workstation, which automatically collects the measurements 

to the scope of the invention. Many other types and con- 55 into a complete three dimensional model. Graphics tools 

figurations of scanning systems could be employed, which allow the scanned model to be viewed within seconds after 

are now known or may be later devised which would be completing a scan. 

equivalent to the SIDEXIS in one or more of its features. The three dimensional color digitizer, such as Cyber- 
The feature of the system of FIGS. 1 and 2 which is relevant ware's Model 3030, scans an object at high resolution in less 
to the invention is that it is suitable for providing dental 60 than a minute and shows the resulting three dimensional 
exposures of x-rays, three dimensional imaging or scanning image on a graphics workstation with true-to-life color. The 
and superficial images in a single gantry or scanning mecha- availability of color information to three dimensional digi- 
nism shared by all of the exposure and detection elements. tizing provides nearly all the information a graphics appli- 
Device 10 can also be reconfigured to provide teleradiog- cation needs to fully describe an object. In addition to 
raphy by means which is conventional and thus will not be 65 enhancing realism in graphic models, color denotes bound- 
further discussed here. The point is that the scanning mecha- aries that are not obvious from shape alone. Color indicates 
nism used in the invention may be of any type now known surface texture and reflectance. By marking by any visible 
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means available an object's surface before digitizing, color 
can be used to transfer ideas from the object to the graphic 
model. In specialized applications, color can reveal charac- 
teristics such as skin discoloration. 

The digitizer is entirely software controlled, and requires 
no user adjustments in normal use. In operation, the digitizer 
shines a safe, low-intensity laser on an object to create a 
lighted profile. A high-quality video sensor captures the 
profile from two viewpoints. The system can digitize thou- 
sands of these profiles in a few seconds to capture the shape 
of the entire object. 

Simultaneously, a second video sensor acquires color 
information. 

The scanning process captures an array of digitized 
points, with each point represented by x, y, and z coordinates 
for shape and 24-bit RGB coordinates for color. The digi- 
tizer transfers this data via SCSI to a graphics workstation 
for immediate viewing and modification. 

The digitizer operates under the control of software 
running on a graphics workstation. The scanning process is 
thus automatic and easily adaptable to a variety of different 
requirements. Either rectangular or cylindrical scans can be 
performed depending on the shape of the object to be 
scanned. Multiple scans of a complex object can be com- 
bined into one model. 

Software tools available from Cyberware allow manipu- 
lation and analysis of the three dimensional models in a 
variety of ways. Automatic measurement attributes such as 
area and volume can be obtained of selected portions of the 
three dimensional image. The models can be edited with 
operations such as clipping, scaling, and image cut and 
paste. 

Popular third-party multimedia programs from Autodesk, 
Wavefront, and Alias, for example to work with the three 
dimensional models. Translation tools are available that 
convert the data array to a form readable by many third -party 
programs. Special-purpose translation routines may be cus- 
tom created by the user. A feature extraction tool prepares 
three dimensional models for use in computer-aided design 
and other applications. 

The scanner includes a completely self-contained optical 
digitizing head. It includes a low-intensity laser light source; 
quartz-coated, first-surface mirror assembly; high-quality 
imaging optics; 100% blemish-free, CCD (solid-state) video 
range and color sensors; and supporting electronics. 

In an alternative embodiment after the x-ray, surface and 
contour images of the patient's head has been taken by the 
digitizer describe above, it is then possible to use a light or 
sonic handheld probe 32 such is described in connection 
with U.S. Pat. No. 5,278,756 to identify anatomical land 
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The object of the invention is that a real time visual or 
color video scan of the superficial facial and jaw structure of 
the patient is taken at the same time or at least at a time 
thereafter in which the patient is still in the same position 
and apparatus 10 has taken a panograpbic x-ray exposure 
and image. Three sets of data, one corresponding to the 
panographic x-ray, one corresponding to the facial color 
video image, and another corresponding to the optically 
identified anatomical landmarks are then established in the 
exposure space at or within the time of a single exposure 
session so that the data can be correlated before rendition of 
the display of each of the sets of data and preferably, but not 
necessarily, at the same time each set of data it is obtained 
through the use of a single mechanical scanning stage or 
mechanism. 

For example, FIG. 3 diagrammatically illustrates patient 
20 as would be seen in a color video image of the patient's 
face showing the superficial parents of the teeth, lips, chin 
and jaw structure as would be commonly be seen by an 
observer. 

In FIG. 5, the optically determined three dimensional 
physical contour of the patient's face, and in particular the 
lips, and selected anatomical landmark positions within the 
patient's jaw structure or teeth are established in three 
dimensional space. Any depiction of the topology of the 
patient's face may be employed such as a mesh-net repre- 
sentation or topological contour or elevation lines. 

In FIG. 4 the panographic x-ray of the teeth and jaw 
structure of the patient in digitized form is depicted. These 
three images, which may be scanned simultaneously or at 
least within the same exposure session can then be point by 
point correlated or superimposed on each other in order to 
obtain a composite image such as shown in FlGT 6 . It shoulcf 
35 become readily apparent that the composite image allows 
the orthodontic surgeon to quickly and readily visualize the 
relationship between jaw and tooth structure on one hand 
and facial lip and jaw contours, landmarks and superficial 
visual appearance on the other. The format and resolution of 
each of the sets of data may be the same or different from 
each other and from the display of the set of data according 
to user convenience and choice. 

Through three dimensional computer morphed 
techniques, using conventional software, it is then possible 
45 to move or change tooth or jaw structure positions and 
according to user selection. A corresponding three dimen- 
sional contours which have a scanned or measure relation- 
ship to the original x-ray data will be carried in the image 


25 


30 


40 


with the x-ray data resulting in a morphed or altered corn- 
marks in the patient's jaw structure anaVofT&ewffile the 50 posite display of FIG. 6. The composite display can of 
patient is still maintained in the exposure position as shown course be deconvolved into any one of its constituent parts 
in FIG. 1 to include in a combined graphic model. Again, the as shown in FIGS. 3, 4 and 5 according to user selection as 
specific means by which the anatomical tooth and jaw may be needed or desired for visualization, 
structure of the patient are determined through optical laser FIG. 7 is a block diagram of the system 10 of the 
means need not be identical or even the same as discussed 55 invention which shows an X-ray exposure and detection 
in connection with U.S. Pat. No. 5,278,756, but may include system 40 carried by gantry 28 with a three dimensional 
any type of three dimensional spatial orientation apparatus contours scanning system 42 and a surface image scanning 
and methodology now known or later devised. In particular, system 44. X-radiation, light, sonic energy is thus swept 
patient landmarks may be made by the surgeon or orthodon- over patient 20 and the data simultaneously or near simul- 
tics in the graphically displayed data itself by computer 60 taneously provided in a correlated fashion to computer 
marking a point in the displayed image with a marker using system 14 in which the three sets of data from systems 40, 
a computer mouse or pen. The land -marked points can then 42 and 44 are stored in a correlated fashion. Thereafter, 
be specifically used in later applied, conventional data computer 14 may display the image of patient 20 by any one 
reductions methodologies to compute tracings or to provide of scanning systems, 40, 42 and 44 and further provide a 
keystone points which will be moved or rotated according to 65 composite image of each of these systems. Most 
expected orthodontics or oral surgery to provide a morphed importantly, data taken by one system is correlated to the 
image. data in another system as determined by the initial measure- 
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ment. Therefore, later when the operator through conven- 
tional computer graphing techniques morphs the data in any 
one set, the data in the other two sets can similarly be 
morphed in the same manner to obtain a correlated separate 
or composite image. In this way, surgical or o rthodontic 5 
changes in the tooth or bone structure can be computer 
simulated and the contour and visual appearance of the 
patient's lips, teeth and jaw will be immediately correlated 
thereto and displayed in monitor 16. 

It must be expressly understood that more than or less io 
than three data scanning systems may be employed to 
produce correlated data sets for orthodontic or oral surgery 
purposes, and there is no restriction under the invention as 
to what type of scanning mechanism or measurement signal 
might be employed. 

Many alterations and modifications may be made by those 
having ordinary skill in the art without departing from the 
spirit and scope of the invention. Therefore, it must be 
understood that the illustrated embodiment has been set 
forth only for the purposes of example and that it should not 
be taken as limiting the invention as defined by the following 
claims. 

It is to be expressly understood that the scanning, 
exposure, detection, computer, and software components of 
the invention which have been specifically described above 
are not to be read as limiting the invention, which is to 
include all known or later devised methods and apparatus for 
performing the same or similar functions in the dental and 
orthodontic fields. 

The words used in this specification to describe the 
invention and its various embodiments are to be understood 
not only in the sense of their commonly defined meanings, 
but to include by special definition in this specification 
structure, material or acts beyond the scope of the commonly 
defined meanings. Thus if an element can be understood in 
the context of this specification as including more than one 
meaning, then its use in a claim must be understood as being 
generic to all possible meanings supported by the specifi- 
cation and by the word itself. 

The definitions of the words or elements of the following 
claims are, therefore, defined in this specification to include 
not only the combination of elements which are literally set 
forth, but all equivalent structure, material or acts for 


a scanning gantry in which said plurality of scanning 
devices are mounted at least in part for scanning said 
patient; and 

a computer system for correlating output from each of 
said multiple scanning devices to provide at least a 
composite image of said patient attained therefrom in 
which said measure data of said multiple scans are 
correlated to each other, 
wherein said plurality of scanning devices acquires sub- 
surface structural data from said patient by at least a 
first scanning device and surface data from said patient 
by at least a second scanning device, said subsurface 
structure data and surface data from said patient being 
correlated by said computer system to provide a com- 
posite image of subsurface structural data and surface 
data of said patient. 

2. An apparatus for simultaneously providing multiple 
scans of measured data from a patient comprising: 

a plurality of scanning devices for providing said multiple 

scans of measured data from said patient; 
a scanning gantry in which said plurality of scanning 
devices are mounted at least in part for scanning said 
patient; and 

a computer system for correlating output from each of 
said multiple scanning devices to provide at least a 
composite image of said patient attained therefrom in 
which said measure data of said multiple scans are 
correlated to each other, 
wherein said plurality of scanning devices acquires tooth 
and jaw structure data in a first scanning device, three 
dimensional contour data through a second scanning 
device and superficial surface data through a third 
scanning device, said tooth and jaw structure, three 
dimensional contour data and superficial surface data 
being correlated by said computer system to provide a 
composite image thereof. 

3. The apparatus of claim 2 wherein said first scanning 
device of said plurality of scanning devices includes an 

40 x-ray exposure device. 

4. The apparatus of claim 2 wherein said first scanning 
device of said plurality of scanning devices includes a 
panoramic x-ray exposure device. 

5. The apparatus of claim 2 wherein said first scanning 


25 


30 


35 


performing substantially the same function in substantially 45 device of Mid plurality of scanning devices incorporates a 


the same way to obtain substantially the same result. In this 
sense it is therefore contemplated that an equivalent substi- 
tution of two or more elements may be made for any one of 
the elements in the claims below or that a single element 
may be substituted for two or more elements in a claim. 

Insubstantial changes from the claimed subject matter as 
viewed by a person with ordinary skill in the art, now known 
or later devised, are expressly contemplated as being equiva- 
lent^ within the scope of the claims. Therefore, obvious 
substitutions now or later known to one with ordinary skill 
in the art are defined to be within the scope of the defined 
elements. 

The claims are thus to be understood to include what is 
specifically illustrated and described above, what is concep- 


50 


55 


teleradiographic x-ray exposure device. 

6. The apparatus of claim 2 wherein said third scanning 
device of said plurality of scanning devices includes a video 
imaging device. 

7. The apparatus of claim 2 wherein said second scanning 
device of said plurality of scanning devices includes a three 
dimensional scanning device. 

S. The apparatus of claim 2 wherein each of said plurality 
of scanning devices acquires data simultaneously and simul- 
taneously stores said multiple data in said computer system 
as correlated data. 

9. The apparatus of claim 2 wherein said plurality of 
scanning devices acquires data in sequence doing a single 
exposure session of said patient and stores said sequentially 


tionally equivalent, what can be obviously substituted and 60 acquired data as correlated within said computer system, 
also what essentially incorporates the essential idea of the 10. The apparatus of claim 2 wherein said data from said 
invention. first, second and third scanning devices is taken simulta- 

I claim: neously. 

1. An apparatus for simultaneously providing multiple 11. The apparatus of claim 2 wherein said data taken from 

scans of measured data from a patient comprising: 65 said first, second and third scanning devices is taken with 
a plurality of scanning devices for providing said multiple respect to one of said scanning devices sequentially during 
scans of measured data from said patient; the same exposure session of said patient. 
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12. A method of creating correlated multiple scans of a 
patient to correlate bone structure to skin contour and to 
surface appearance comprising: 

imaging a bone structure, skin surface contour and skin 
surface image of a patient by correlated multiple scans 
of the same; and 

simultaneously displaying said multiple scans of corre- 
lated data to produce a composite image. 

13. The method of claim 12 where said imaging occurs 
simultaneously with respect to each of said correlated scans. 


12 


14. The method of claim 12 wherein said imaging occurs 
at least in part sequentially with respect to said correlated 
scans at the same patient session. 

15. The method of claim 12 wherein said imaging 
acquires panoramic x-ray data simultaneously with three 
dimensional contour of a patient's lips, teeth and jaw struc- 
ture with simultaneous surface images of a patient's lip and 
jaw structure to produce said composite image. 
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Method and apparatus for registering an object of known 
predetermined geometry to scanned three dimensional data 
such that the object's location may be verified. Such a 
known object may comprise a less than ideal three-dimen- 
sional (3-D) digital object such as a tooth, a dental appliance 
(e.g., as a tooth bracket model) or other like object, including 
portions thereof. Knowledge of such an object's location is 
generally helpful in planning orthodontic treatment, particu- 
larly where the location of the object needs to be determined 
or confirmed or where incomplete or poor scan data is 
obtained. Aspects of the present invention provide methods 
of effectively verifying dental appliance location and dis- 
playing appliance locations using a computer and three- 
dimensional models of teeth. 
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ABSTRACT 


An image processing method for use in dentistry or orth- 
odontic is provided. Two images of teeth one being a 
two-dimensional image and one a three-dimensional image 
are combined in a manner to allow the use of information 
obtained from one to the other. In order to combine the two 
images a set of basic landmarks is defined in one, identified 
in the other and then the two images are registered. 
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ABSTRACT 


A system and method for generating and utilizing a com- 
puter model of the craniofacial features of a patient is 
claimed. To create the computer model, three-dimentional 
data regarding the patient's facial features, dental features 
and skeletal features is collected. Data regarding facial 
features is acquired using laser scanning and digital photo- 
graph. Data regarding dental features are acquired by physi- 
cally modeling the teeth and laser scanning the models. 
Lastly, data regarding the skeletal features is obtained from 
radiographs. The data are combined into a single computer 
model that can be manipulated and viewed in the three - 
dimensions. The model also has the ability to be animated 
between the current modeled craniofacial features and theo- 
retical craniofacial features. 
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SYSTEM AND METHOD OF DIGITALLY 
MODELLING CRANIOFACIAL FEATURES FOR 
THE PURPOSES OF DIAGNOSIS AND 
TREATMENT PREDICTIONS 

BACKGROUND OF THE INVENTION 
[0001] 1. Field of the Invention 

[0002] In general, the present invention relates to systems 
and methods that are used to diagnose craniofacial defor- 
mities and predict outcomes to various treatments for those 
deformities. More particularly, the present invention relates 
to computer imaging and modeling systems that are used to 
create and manipulate craniofacial images. 

[0003] 2, Description of the Prior Art 

[0004] The craniofacial characteristics of each person are 
unique, thereby defining a person's appearance. However, 
due to genetics, some people are born with undesired 
craniofacial features or craniofacial deformities. Further- 
more, in this dangerous world, many people incur injuries to 
there craniofacial features that must be treated. 

[0005] The task of treating craniofacial trauma, correcting 
craniofacial deformities and altering undesired craniofacial 
features typically fall into the practice of orthodontists, oral 
surgeons and plastic surgeons, depending upon the type of 
corrective measures required. 

[0006] When a surgeon or orthodontist alters the cranio- 
facial features of a patient, the appearance of the patient may 
change. Both physicians and patients are very weary of this 
change. Often, the change to the craniofacial features can be 
anticipated. For example, when a patient has a few crooked 
teeth straightened, the physician and patient alike can easily 
visualize the patient's appearance. However, other proce- 
dures are not so easily visualized. If a patient is having jaw 
surgery, a rhinoplasty or other such procedure, both the 
physician and the patient want to visualize the change prior 
to undergoing the operation. The physician needs to visu- 
alize the anatomical change for the purposes of diagnosis. 
The patient wants to visualize the change because it is 
his/her appearance that is to be altered. 

[0007] The prior art is replete with systems that help 
physicians and patients predict the changes that will occur in 
a patient's anatomy and appearance as a result of craniofa- 
cial surgery. Many such systems are currently commercially 
available and are sold under trade names, such as Quick 
Ceph, Dentofacial Planner, Orthovision, Dolphin Imaging 
and the like. 

[0008] However, the craniofacial features of a person are 
three-dimensional. Most all the commercially available sys- 
tems for imaging craniofacial features only provide two- 
dimensional images. As such, these prior art systems only 
enable physicians and patients to view changes in the profile 
view. Such predictions are useful but are not sufficient to 
truly visualize a changes that may occur after a craniofacial 
procedure. Some systems have been developed that attempt 
to provide imaging in three dimensions. Such systems are 
exemplified by U.S. Pat. No. 6,081,739 to Lemchen, entitled 
Scanning Device Or Methodology To Produce An Image 
Incorporating Correlated Superficial Three Dimensional 
Surface And X-Ray Images And Measurements Of An 
Object; U.S. Pat. No. 5,867,588 to Marquardt, entitled 


Method And Apparatus For Analyzing Facial Configurations 
And Components; and U.S. Pat. No. 5,659,625 to Mar- 
quardt, also entitled Method And Apparatus For Analyzing 
Facial Configurations And Components. A problem with 
such prior art three-dimensional systems is their inability to 
accurately map external facial appearance with both the 
skeletal structure of the patient and the dental structure of the 
patient in a single image. 

[0009] A need therefore exists for an improved method 
and system for creating three-dimensional models of a 
patient, that accurately includes external facial features, 
skeletal features and dental features, wherein that model can 
be virtually altered for diagnostic and treatment outcome 
purposes. This need is met by the present invention as 
described and claimed below. 

SUMMARY OF THE INVENTION 
[0010] The present invention is a system and method for 
generating and utilizing a computer model of the craniofa- 
cial features of a patient. To create the computer model, 
three-dimentional data regarding the patient's facial fea- 
tures, dental features and skeletal features is collected. Data 
regarding facial features is acquired using laser scanning and 
digital photographs. Data regarding dental features are 
acquired by physically modeling the teeth and laser scanning 
the models. Lastly, data regarding the skeletal features is 
obtained from radiographs. The data is combined into a 
single computer model that can be manipulated and viewed 
in the three-dimensions. The model also has the ability to be 
animated between the current modeled craniofacial features 
and theoretical craniofacial features. In this manner, the 
computer model can be used to diagnose abnormalities, and 
approximate physiological changes that may occur because 
of corrective surgery, braces, aging and/or growth. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0011] For a better understanding of the present invention, 
reference is made to the following description of an exem- 
plary embodiment thereof, considered in conjunction with 
the accompanying drawings, in which: 

[0012] FIG. 1 is a block diagram schematic of the overall 
modeling system and method in accordance with the present 
invention; 

[0013] FIG. 2 is a block diagram schematic illustrating the 
method steps used to collect facial feature data; 

[0014] FIG. 3 is a block diagram schematic illustrating the 
method steps used to collect dental feature data; 

[0015] FIG. 4 is a block diagram schematic illustrating the 
method steps used to collect skeletal feature data; 

[0016] FIG. 5 is a perspective view of an exemplary 
embodiment of a bite jig; 

[0017] FIG. 6 is a block diagram schematic illustrating the 
method steps used to collect dental feature orientation data 
using the bite jig of FIG. 5; and 

[0018] FIG. 7 is a block diagram schematic illustrating the 
method step used in integrating the craniofacial model from 
the collected data. 

DETAILED DESCRIPTION OF THE 
INVENTION 

[0019] The present invention is a system and method for 
generating a digital representation of the craniofacial fea- 
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tures of a patient, wherein the digital representation includes 
exact skeletal features, dental features and soft tissue facial 
features. The digital representation can then be altered 
and/or animated. By having the ability to alter and/or 
animate the digital representation, a process is created that 
is highly useful in diagnosing craniofacial problems and 
visualizing physical changes that can be created by various 
types of treatments. 

[0020] Referring to FIG. 1, it can be seen that the present 
invention system and method 10 contains three stages. The 
first stage is the data collection stage. During the data 
collection stage, data of a patient's craniofacial features is 
collected. As is indicated by Block 12, facial feature data is 
collected that is representative of the external appearance of 
the soft tissue components of a patient's face. As is indicated 
by Block 14, dental feature data is collected that is repre- 
sentative of the condition and orientation of that patient's 
teeth. As is indicated by Block 16, data is also collected on 
the skeletal features of the patient. Lastly, as is indicated by 
Block 18, orientation data is collected that is used to orient 
the dental feature data in the overall craniofacial model. The 
steps used to collect the various types of data are unique and 
will later be explained in more detail. 

[0021] Once all the data is collected, the second stage of 
the system and method 10 is implemented. As is indicated by 
Block 20, the collected data from stage one is manipulated 
to create an accurate digital craniofacial model of the 
patient. As will be later explained, the craniofacial model 
models a patient's craniofacial features in three dimensions 
that can be viewed from any vantage point. The manipula- 
tion of the collected data in stage two is done in a computer 
through the use of novel software applications, as will also 
be later explained 

[0022] The third stage of the system and method 10 is the 
use of the craniofacial model by a physician or patient. As 
is indicated by Block 22, the craniofacial model can be 
animated to illustrate features through a variety of changing 
expressions. The craniofacial model can also be used to 
diagnose craniofacial abnormalities, as is indicated by Block 
24. The animation of the craniofacial model is very useful in 
diagnosing abnormalities that manifest themselves when a 
patient chews, smiles, yawns or otherwise undergoes move- 
ment in the craniofacial structure. Furthermore, as is indi- 
cated by Block 28, the craniofacial model can be used to 
predict changes to the craniofacial features created by aging, 
growth, surgery or orthodontic appliances. 

[0023] Each of the logic blocks illustrated in FIG. 1 can 
be multiple process steps. Each of the logic blocks shown in 
FIG. 1, will therefore be individually described, beginning 
with the data collection blocks in stage one. 

[0024] Referring to FIG. 2, the method of collecting facial 
data is more specifically described. To collect facial data, 
low gloss make-up is applied to the face of a patient. See 
Block 30. The low gloss make-up is desired in order to 
accurately scan the facial features with a laser scanner. If 
make-up were not used, shinny points on the skin may 
distort the scanned image being collected. Furthermore, as is 
indicated by Block 32, the teeth are covered. Hie teeth are 
skinny and reflect laser light. So to prevent distortions in a 
laser scan, the teeth are covered with a non-reflective 
material. Orientation points are then marked in Ihe make-up 
at predetermined points. 


[0025] Prior to laser scanning the patient's facial features, 
the patient's face is photographed using a digital camera. 
This is shown by Block 34. Several pictures may be taken, 
wherein different pictures are taken at known distances and 
at known angles relative the primary plane of the patients 
face. Digital pictures may also be taken of different facial 
expressions, such as a smile, a grin, an mouth open and the 
like. 

[0026] After the digital pictures have been taken, the 
patient's face is then scanned with a non-contact laser 
scanner. An example of an appropriate non-contact laser 
scanner would be the Vivid 700 model laser scanner pro- 
duced by Minolta. The patient's face is scanned from the 
same positions and with the same expressions as were the 
digital picture. In this manner, a laser scan can be associated 
with a digital picture. 

[0027] Using the data collected from each laser scan, a 
model grid framework of the patient's face is generated 
using commercial software. This is indicated by Block 36 in 
FIG. 2. For example, if a Vivid 700 laser scanner is used, 
Vivid 1.3 software can be used to create a model grid 
framework of the collected data. The orientation points 
placed on the patient's face are noted on the grid framework. 
The digital picture corresponding to each laser scan also 
contains the same orientation points, as does each laser scan. 
Using the orientation points as references, the digital picture 
for each laser scan is overlaid over the model grid frame- 
work that was generated for that scan. This process is 
indicated by Block 38 in FIG. 2. This provides facial texture 
to the collected data. Once the overlays are complete, a first 
digital model 40 is produced that corresponds to the facial 
characteristics of a patient. The facial feature model 40 is 
three-dimensional and contains data points from different 
perspectives and with different facial expressions. 

[0028] Referring to FIG. 3, the steps involved in collect- 
ing dental feature data are described. To collect dental 
feature data on a patient, impressions are taken of the 
patient's teeth using conventional techniques. Block 42 in 
FIG. 3 shows this process. Three-dimensional physical 
models of the teeth are then made from the impressions, as 
is indicated by Block 44. Orientation points are placed on 
the physical models. Once the physical models are complete, 
the models are scanned using a non-contact laser scanner. 
Block 46 indicates this process. A computer model 48 of the 
patient's dental features is therefore created that represents 
the patient's actual dental features in three dimensions. 

[0029] Referring to FIG. 4, the steps involved in collect- 
ing skeletal data are described. To collect skeletal data, 
lateral and FA radiographs are taken of the skull using 
traditional radiology techniques. This process is shown by 
Block 50 in FIG. 4. Data points from the radiographs are 
then read into a computer, as is indicated by Block 52. 
Furthermore, as is indicated by Block 54, a generic three- 
dimensional skull is generated in the computer using com- 
mercial software. The data points from the radiographs are 
then projected around the generic skull, Using commercial 
software, such as 3D Studio Max, the generic skull computer 
model can be morphed to match the data points collected 
from the radiographs. This process is shown by Block 56 in 
FIG. 4. The result is a computer model 58 of a skull that 
mimics the actual skull of the patient. 

[0030] Referring to FIG. 5, a bite jig 60 is shown that is 
used in the process of collecting dental orientation data. The 
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bite jig 60 has a bite plate 62 that engages the teeth within 
the mouth. A shaft 64 extends away from the bite plate 62. 
The shaft 64 terminates with an orientation plate 66 that has 
reference points 68 on it. 

[0031] Referring to FIG. 6, the method of collecting 
dental orientation data with the bite jig 60 (FIG. 5) is 
described. As is indicated by Block 70, the bite jig is placed 
in the mouth of the patient and is engaged by the patient's 
teeth. Once in place, the patient's face is again scanned using 
the non-contact laser scanner, as is indicated by Block 72. 
The laser scans, therefore, collect data reference points from 
the patient's face as well as reference points from the 
orientation plate 66 (FIG. 5) on the bite jig. 

[0032] As is indicated by Block 74, the bite jig is then 
affixed to the physical models of the teeth that have been 
previously prepared. Once the bite jig is affixed to the 
models of the teeth, the entire assembly is scanned with the 
non-contact laser scanner. Block 76 indicates this process. 
As has been previously mentioned, the physical models of 
the teeth contain reference points that are detected in the 
laser scan. The orientation plate 66 (FIG. 5) on the bite jig 
also contains reference points that are detected by the laser 
scan. By scanning the model of the teeth engaging the bite 
jig, the orientation of the bite plate relative to the teeth 
becomes known. 

[0033] Returning to FIG. 1, it will now be understood that 
from stage one of the process, three-dimensional models of 
the facial features, dental features, and skeletal features 
become known. See Blocks 12, 14 and 16. Furthermore, the 
positional relationship between the facial features and the 
orientation plate of the bite jig are known, as is the positional 
relationship between the orientation plate of the bite jig and 
the modeled teeth. See Block 18. 

[0034] Once this data is collected, stage two begins 
wherein the collected data is integrated into a single cran- 
iofacial model. The integration of the various data models 
can be done in a number of different ways. Referring to FIG. 
7, it can be seen that since the positional relationship of the 
bite jig's orientation plate 66 (FIG. 5) is known relative to 
both the facial features and the dental features, the dental 
features can be oriented with the facial features by simply 
aligning common points on the orientation plate. The model 
of the facial features and the model of the dental features 
therefore integrate into a single model in a simple fashion. 
This initial integration is shown by Block 80 in FIG. 7. To 
integrate the skeletal features into the combined facial 
feature/dental model, the profile of the facial features is 
aligned over the profile of the modeled skull, as indicated by 
Block 82. A front view of the facial features is then aligned 
with a front view of the modeled skull. The alignment is 
done along the mid-sagittal plane. Once proper alignment is 
achieved, the skeletal feature model and the facial feature 
model are integrated using commercially available best-fit 
algorithms, as is indicated by Block 84. 

[0035] The result after integration is a single craniofacial 
model 86 that contains detailed data about a patient's facial 
features, skeletal features and dental features. The cranio- 
facial model 86 is three-dimensional, thereby producing a 
three-dimensional digital representation of a patient's cran- 
iofacial features, 

[0036] Now that a three-dimentional representation of a 
patient's craniofacial structure has been developed, stage 


three (FIG. 1) can be started. In stage three, it can be seen 
that the craniofacial model can be used as a tool for medical 
diagnosis. See block 24 in FIG. 1. Using just a static 
three-dimentional model, a physician can visualize the 
asymmetry of dental arches from a coronal perspective. Jaw 
deformities, nasal deformities and eye socket deformities 
can also readily be visualized from the model. Furthermore, 
deformities in the soft tissue of the face can also be visu- 
alized. 

[0037] To assist in diagnosis, the craniofacial model can 
also be animated, as is indicated by Block 22 in FIG. 1. To 
animate the model, many types of commercial animation 
software can be used, provided that software supports digital 
multi-frame animation. Examples of appropriate software 
packages are 3D Studio Max and Softimage. As has been 
previously mentioned, the facial features of the patient are 
scanned in a plurality of different poses. Using animation 
algorithms, any existing pose can be animated to morph into 
any other pose. As such, the model can be animated to smile, 
frown, chew or undergo any desired craniofacial movement. 

[0038] The last way to manipulate the craniofacial model 
is to create artificial conditions and morph the craniofacial 
model to those artificial conditions. For example, a surgeon 
can create a false nose that illustrates what a patient's nose 
will look like after a surgical procedure. The craniofacial 
model can then be morphed into a condition that contains the 
false nose. As such, the patient can be shown before and 
after models of how their face will look after being effected 
by surgery. Furthermore, by morphing the craniofacial 
model into an anticipated future state, a physician can more 
accurately diagnose the effectiveness of different types of 
treatment on a patient's problems. 

[0039] In addition to physical changes caused by surgery 
or braces, other physiological changes can also be illus- 
trated. For instance, the model of a patient's face can be 
aged. If the patient is an adult, the age progression will show 
the onset of wrinkles and a loss of elasticity in the skin. If 
the patient is a juvenile, the age progression will show 
growth and maturity of the craniofacial features. In order to 
change the existing craniofacial model into any theoretical 
appearance, a final likeliness of that appearance must be 
added to the database of the model. The craniofacial model 
can then be easily morphed into that theoretical appearance. 
The creation of the theoretical appearance can be done by 
the physician or can be done by a computer artist who is 
knowledgeable in craniofacial physiology. The use of the 
model to predict physiological changes is shown by Block 
28 in FIG. 1. 

[0040] It will be understood that the embodiment of the 
present invention system and method described and illus- 
trated herein are merely exemplary and a person skilled in 
the art can make many variations to the embodiments shown 
without departing from the scope of the present invention. 
All such variations, modifications and alternate embodi- 
ments are intended to be included within the scope of the 
present invention as defined by the appended claims. 

What is claimed is: 

1. A method of creating a digital computer model of the 
craniofacial features of a person, comprising the steps of: 

creating a first computer model of the person's facial 
features; 


12/17/2003, EAST Version: 1.4.1 


US 2002/0176612 Al 


4 


Nov. 28, 2002 


producing a physical model of Ihe person's teeth; 

creating a second computer model of said physical model 
of said teeth; and 

integrating said first computer model and said second 
computer model into a master computer model. 

2. The method according to claim 1, further including the 
step of creating a third computer model of the person's skull. 

3. The method according to claim 2, further including the 
step of integrating said third computer model into said 
master computer model. 

4. The method according to claim 1, wherein said step of 
creating a first computer model includes the sub step of 
scanning the person's face in a plurality of poses with a laser 
scanner. 

5. The method according to claim 4, wherein said step of 
creating a first computer model includes taking a plurality of 
digital photographs of the person's face. 

6. The method according to claim 5, further including the 
sub step of combining data from said scans and said digital 
photographs. 

7. The method according to claim 1, wherein said step of 
creating a second computer includes the sub step of scanning 
said physical model of said teeth with a laser scanner. 

8. The method according to claim 1, further including the 
step of creating a bite jig having an orientation plate that 
extends outside the mouth. 

9. The method according to claim 8, further including the 
steps of: 

scanning the patient's head while biting the bite jig to 
create a first collection of data points; 

coupling said physical model of said teeth to said bite jig 
in a subassembly; and 

scanning said subassembly to create a second collection 
of data points. 

10. The method according to claim 9 wherein said step of 
integrating said first computer model and said second com- 
puter model includes orienting said first computer model 
with said second computer model using said first collection 
of data points and said second collection of data. 

11 . The method according to claim 2, wherein said step of 
creating a third computer model, includes the sub steps of: 

generating a generic skull model; 

inputting data corresponding to the skull of the person; 


altering the generic skull model to correspond to the data 
corresponding to the skull of the person. 

12. A method, comprising the steps of: 

creating a three-dimentional computer model of a per- 
son's craniofacial features, that includes skeletal fea- 
tures, dental features and facial features; 

animating said computer model. 

13. The method according to claim 12, wherein said step 
of creating a three-dimentional computer model includes the 
sub steps of: 

creating a first computer model of the person's facial 
features; 

producing a physical model of the person's teeth; 

creating a second computer model of said physical model 
of said teeth; and 

integrating said first computer model and said second 
computer model into a master computer model. 

14. The method according to claim 12, wherein said step 
of animating said computer model includes creating a theo- 
retical appearance of craniofacial features and animating 
said computer model between modeled craniofacial features 
and said theoretical appearance. 

15. The method according to claim 14, wherein said step 
of animating said computer model includes animating said 
computer model to mimic actions selected from a group 
consisting of chewing, grinning, smiling, growing and 
aging. 

16. The method according to claim 14, further including 
the step of creating a third computer model of the person's 
skull. 

17. The method according to claim 16, further including 
the step of integrating said third computer model into said 
master computer model. 

18. The method according to claim 14, wherein said step 
of creating a first computer model includes the sub step of 
scanning the person's face in a plurality of poses with a laser 
scanner. 

19. The method according to claim 18, wherein said step 
of creating a first computer model includes taking a plurality 
of digital photographs of the persons' face. 

20. The method according to claim 19, further including 
the sub step of combining data from said scans and said 
digital photographs. 
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[57] 


ABSTRACT 


A method for cephalometric evaluation includes steps 
of generating radiographic, X-ray or other image of a 
patient's individual orthodontic structure, positioning 
this image in alignment with a graphical depiction of a 
norm value orthodontic structure, and comparing the 
individual's structure to the norm value structure to 
analyze development and to determine a course of or- 
thodontic or other treatment. 

8 Claims, 3 Drawing Sheets 
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METHOD OF CEPHALOMETRIC EVALUATION 
OF DENTAL RADIOGRAPHS 

BACKGROUND OF THE INVENTION 5 

This present invention relates to an improved method 
for cephalometric evaluation and more particularly to a 
method of analysis through comparison of depictions of 
structures in orthodontic patients to a normal value 
orthodontic and/or cranial structure for like patients of 10 
similar age or development. 

The standard method for cephalometric evaluation of 
orthodontic patients is to take a radiograph (X-ray) and 
to plot specific points of interest. By plotting lines, an- 
gles and linear measurements, the practitioner is able to 13 
evaluate growth and development of an individual pa- 
tient's orthodontic structures. These lines, angles and 
linear measurements are compared to other average or 
"norm" values of lines, angles and linear measurements 
as a base standard. The practitioner is required to care- 20 
fully and, as accurately as possible, to plot out each 
point line and angle and measure each of these individu- 
ally. Almost all methods of cephalometric analysis use 
the same specific points of interest for measurement. 
The practitioner focuses on points which yield the most 25 
helpful and consistent results for determining relative 
growth and development in orthodontic structures. 

The measurements obtained from cephalometric 
analysis allow the practitioner to compare individual 
patients to average or norm patients of similar ages and 30 
ethnic backgrounds. One function of cephalometric 
analysis is to allow the practitioner to compare dental 
relations of a patient to individuals who exhibit norma- 
tive occlusion. Another function is to compare skeletal 
relations of a patient's skeletal anteroposterior compo- 35 
cents to skeletal norms of similar individuals. The mea- 
surements also enable the practitioner to relate soft 
tissue outlines of a patient's face to ethnically similar 
individuals with normative occlusion. All of these func- 
tions enable the practitioner to establish the direction of 40 
growth and development in an individual's orthodontic 
structures. Once the direction of growth and develop- 
ment is established the practitioner can determine 
whether any orthodontic procedures are necessary to 
obtain a "norma)*' relationship. In addition, the mea- 45 
surements are helpful in determining whether an indi- 
vidual patient is at risk for certain types of temporoman- 
dibular joint (TMJ)dysf unction and if the patient al- 
ready has TMJ dysfunction, the measurements help 
determine the desired steps for treatment. 50 

Although the standard method of cephalometric 
analysis yields the desired results, there are several dis- 
advantages which practitioners have struggled with for 
years. Manually plotting the specific points of interest 
and measuring the resulting lines and angles is ex- 55 
tremely tedious and time consuming. The ability to 
obtain optimal precision is limited by the potential for 
human error in obtaining the measurements. The stan- 
dard method is also subject to obvious radiographic 
distortion in areas where two overlapping structures are 60 
superimposed. 

Various other features of the present invention will 
become obvious to one skilled in the art upon reading 
the disclosure set forth herein. 

SUMMARY OF THE INVENTION 65 

One of the objects of the present invention is to pro- 
vide a method of cephalometric analysis that eliminates 


,441 2 

the need for plotting and measuring specific points, lines 
and angles. 

Another object is to provide such a method which 
increases the accuracy of cephalometric analysis by 
decreasing the possibility of errors due to drafting mis- 
takes or other mistakes likely t occur using the stan- 
dard method of analysis. 

Another object is to provide such a method which is 
quicker, easier and more cost effective than the stan- 
dard method. 

Another object is to provide such a method which 
allows the practitioner to compare an individual pa- 
tient's orthodontic structures to a two dimensional 
norm orthodontic structure. 

Another object is to provide such a method which 
allows the practitioner to compare orthodontic struc- 
tures by region instead of being limited to specific 
points of interest. 

Another object is to provide such a method which 
allows the practitioner to compare each region indepen- 
dently or to another selected region, or to a base (skull) 
reference. 

Another object is to provide such a method which 
clearly depicts where the structures would be and 
where they actually are in relation to norm orthodontic 
structures. 

Other objects of this invention will be apparent to 
those skilled in the art in light of the following descrip- 
tions and accompanying drawings. 

In accordance with this invention, generally stated, 
an image of a patient's individual orthodontic structure 
is generated, as by taking a radiograph (X-ray). Using 
an image saves time and money compared to using 
linear measurements. The image is also not subject to 
potential drafting mistakes. In addition, the image pro- 
vides a dramatic method for analysis since the practitio- 
ner is able to see an image of the structure itself instead 
of numbers representing the structure. The method 
further comprises positioning the individual orthodon- 
tic structure image in alignment with a graphical depic- 
tion (either a transparent depiction or a graphical dis- 
play of such a picture on a computer display or the like) 
of an average or norm value orthodontic structure for a 
patient of similar age and ethnic background. And then 
a further step of comparing the image to the graphical 
depiction. This method of comparison is quicker and 
easier than the rigorous plotting and measuring in- 
volved in the standard method. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is an image (a lateral radiograph), of a patient's 
orthodontic and cranial structure; 

FIG. 2 is a graphical depiction, preferably on a trans- 
parent background or as displayed on a computer visual 
display, of a norm value orthodontic and/or cranial 
structure for a standard reference of similar race, age 
and/or degree of development showing a selected or- 
thodontic structure (e.g., the upper teeth); 

FIG. 3 shows the graphical depiction of the norm 
value orthodontics structure for the cranium and upper 
teeth of FIG. 2 overlayed on the patient's radiograph of 
FIG. 1 thus graphically showing deviations of the pa- 
tient's upper teeth orthodontic structure (as shown on 
the radiographic image) to that of the norm value refer* 
ence shown in FIG. 2; and 
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FIG. 4 is a view similar to FIG. 2 of a norm value tic structure of FIG. 2 properly positioned on the radio- 

rthodontic and/or cranial structure for a standard graphic image 1 with the reference lines R on the image 

reference showing the lower teeth; and on the reference on the norm value orthodontic 

FIG. 3 is an overlay of the norm value orthodontic depiction being in register with one another. The result- 
structure shown in FIG. 3 overlayed on the patient's 5 ing overlay image shown in FIG. 3 then illustrates the 
image of FIG. 1 showing deviations of the patient** relationship of, for example, the upper teeth reference 
lower teeth orthodontic structure to that of the norm (on the n rm value orthodontic structure) as shown in 
value. FIG. 2 in relation to the corresponding patient's upper 

FIG. 6 is a norm value reference of the soft tissue teeth as shown in FIG. 1. 

structure including the nose and lips and other soft 10 As shown in FIG. 3, the overlay illustrates vertical 

tissue structure which may be overlayed with FIG. 1 and horizontal deviations V and H of the patient's upper 

(not shown) to graphically show the normal value loca- teeth relative to the upper teeth of the norm value or- 

tion of such soft tissue to the actual location of the tbodontic reference structure shown on the transparent 

patient's soft tissue. overlay (FIG. 2). This readily shows the practitioner 

Corresponding reference characters represent corre- 15 where the patient's orthodontic structures are in rela- 

sponding parts throughout the various drawing figures. tion to norm orthodontic structures and also illustrates 

the amount of orthodontic correction required. It will 

DESCRIPTION OF A PREFERRED ^ furthcr appreciated that this method allows the prac- 

EMBODIMENT titioner to compare orthodontic structures by a particu- 

Referring now to the drawing figures, and more par- 20 lar region (e.g., the patient's upper teeth) instead of 

ticularly to FIG. 1, a lateral radiographic (or X-ray) being limited to specific points of interest as were com- 

image, as generally indicated at 1, is shown for a partic- mon in prior cephalometric analysts methods, 

ular patient. The radiographic or X-ray image is shown In a like manner, the norm value orthodontic struc- 

in side elevation and it depicts various structural fea- ture for the patient's lower jaw, as is illustrated in FIG. 

tures of the cranium C and of the patient's upper ortho- 25 4 may be overlaid with the patient's radiograph of FIG. 

dontic structure 3 and the lower orthodontic structure 1 so as to illustrate the position of the patient's lower 

5. It will be understood that frontal images can be used teeth with respect to the norm value of the lower teeth 

with this method as well as lateral images. of such orthodontic structure for a patient of similar 

In accordance with this method, the practitioner then ethnic background. Again, deviation of the patient's 
establishes a reference line (or plane) R on the radio- 30 lower teeth to the norm value position and location of a 
graphic image 1 (as shown in FIG. 1). Reference line R known standard may be determined as was in the case 
is established by drawing a line on the radiographic of FIG. 3 so as to determine the direction and the 
image 1 from the bridge of the nasion to the lower base amount of orthodontic correction required, 
of the skull near the juncture of the mastoid process and FIG. 6 illustrates a norm value reference for the facial 
the lowest portion occipital when viewed laterally. This 35 soft tissue features of the patient in relation to the era* 
line of reference extends through the eye socket and nial and orthodontic structures illustrated in the norm 
can, for example extend through the pterygomaxiallary value overlays shown in FIGS. 2 and 4. It will be appre- 
fissure which is located interiorally of the zygomatic ciated that following a course of orthodontic treatment 
process. that, within a limited degree, the position of the pa- 
Further in accordance with this method of cephalo- 40 tient's lips and chin may be modified to obtain a desired 
metric analysis, the practitioner selects a graphical de- result. 

piction, as shown in FIGS. 2 or 4, of an average or norm In use, the method of the present invention involves 

value orthodontic structure for a patient of similar age first generating an image, preferably a radiographic 

and ethnic background to serve as a reference. For image as shown in FIG. 1 of an individual's orthodontic 

example, if the actual patient who's radiograph is illus- 45 structures, including the upper and lower teeth. Then, 

trated in FIG. 1 is an average 17 year old male or fe- in the manner explained above, a norm value standard 

male, then the graphical depiction for an average 17 orthodontic structure is selected for the patient having 

year old of similar and ethnic background would be a similar age and ethnic background, or being of a simi- 

selected. However, it has been found that in accordance lar stage of development. Then, the individual ortho- 

with this method if the actual radiograph for a patient is 50 dontic structural image is shown on the radiograph of 

compared to his or her norm value orthodontic struc- FIG. 1 is positioned in alignment with the graphical 

ture of similar age and ethnic background and if there is depiction of the norm value orthodontic structure as 

a general state of underdevelopment, then the norm shown on the transparency of FIG. 2 or 4. Then, the 

value structure of a different age reference is utilized. It individual patient's orthodontic structural image, has 

is then assumed that all other cranial and orthodontic 55 shown on the radiograph of FIG. 1 may be compared to 

structure of the patient are in proportion to the refer- the norm value orthodontic structure of FIGS. 2 or 4 

ence. whereby the practitioner may evaluate development of 

Further in accordance with the method of this inven- the individual orthodontic structures and determine the 

tion, the selected norm value orthodontic structure, as course of treatment, the amount and direction of ortho- 

shown in FIGS. 2 or 4, are on a transparent background 60 dontic treatment required. 

which may be laid over the radiograph image shown in The above method using the transparent overlay 

FIG. 1. The reference line R established on the radio- references of FIGS. 2 and 4 is preferred. However, it 

graph is brought into register with a similar reference will be appreciated that the patient's radiographic 
line or plane on the norm value orthodontic structure to image may be graphically displayed on a computer 

form the overlay graphical depiction, as shown in 65 screen and the overlay reference may be combined with 

FIGS. 3 or S. the patient's image on the computer screen rather than 

More specifically, the overlaid image shown in FIG. physically overlaying a transparent reference over the 

3 shows a transparency with the norm value orthodon* patient's X-ray. 


12/17/2003, EAST Version: 1.4.1 


5,318,441 


It will be understood that over an extended course of 
orthodontic treatment, other radiographic images simi- 
lar to FIG. 1 may be taken and compared to the norm 
value orthodontic structure so as to xnonit r the treat* 
ment and to make adjustments to the orthodontic struc- 5 
ture. 

Inasmuch as numerous changes or modifications may 
be made to the preferred embodiment of the invention 
as described in detail hereinabove without departing 
from the spirit and scope of the invention, it is therefore 10 
specifically noted that the scope of the invention is to be 
determined solely by the language of the following 
claims. 

I claim: 

1. Method of evaluating the relationship of individual 15 
orthodontic structures for a patient using a graphical 
depiction of a norm value orthodontic structure for said 
patient, said method comprising the steps of: 

a. generating a radiographic image of said individual 
orthodontic structures for said patient; 20 

b. positioning said individual orthodontic structure 
radiographic image in alignment with said graphi- 
cal depiction of said norm value orthodontic struc- 
tures for said patient; and 

c. graphically comparing said individual orthodontic 25 
structure radiographic image with said graphical 
depiction of said norm value orthodontic structure 

to evaluate development of said individual ortho- 
dontic structures. 

2. A method of claim 1 further comprising selecting 30 
said norm value orthodontic structure by determining a 
crania] base reference for said patient. 


3. The method of claim 2 wherein said step of select- 
ing said n rm value rthodontic structure comprises the 
nasion, the base of the skull, and pterygomaxillary fis- 
sure, or ther selected reference points. 

4. The method of claim 1 wherein said step f gener- 
ating said image of said individual rthodontic structure 
comprises taking a radiographic image of the midface 
and upper teeth. 

5. The method of claim 1 wherein said step of gener- 
ating said image of said individual orthodontic structure 
comprises talcing a radiographic image of the midface 
and upper teeth together with the sinuses, teeth, and 
related structures. 

6. The method of claim 1 wherein said step of gener- 
ating said image of said individual orthodontic structure 
comprises taking a radiographic image of the lower jaw 
and lower teeth. 

7. The method of claims 4, 5, or 6 wherein said step of 
generating said image of said individual orthodontic 
structure further comprises taking a radiographic image 
of the surrounding soft tissue structure of the patient 
including the nose, lips, chin or other related soft tissue 
structure. 

8. The method of claim 1 further comprising repeat- 
ing the steps of claim 1 periodically throughout a course 
of treatment for the patient, monitoring the growth and 
development of said individual orthodontic structures 
of said patient over time, and graphically comparing the 
actual growth of said individual orthodontic structures 
to said image of said norm value orthodontic structure 
with said image serving as a reference. 
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[57] ABSTRACT 

A computerized dental record method includes imaging a 
patient's teeth as a two-dimensional image, visually super- 
imposing an initial three-dimensional computerized tooth 
model onto the two-dimensional image of the patient's teeth, 
interactively adjusting the three-dimensional teeth so that 
they are aligned with the two-dimensional image, and then 
storing the adjusted computer graphic model of the teeth as 
the dental record. 

6 Claims, 4 Drawing Sheets 
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METHOD FOR CREATION AND 
UTILIZATION OF INDIVIDUALIZED 3- 
DIMENSIONAL TEETH MODELS 

CROSS-REFERENCE TO RELATED 5 
APPLICATION 

This application is a Continuation of U.S. patent appli- 
cation Scr. No. 08/785,664, filed Jan. 17, 1997, the disclo- 
sure of which is incorporated by reference. 

FIELD OF THE INVENTION 

The present invention relates to the field of dental 
anatomy and in particular, to storing and utilising 3D com- 
puter graphic structures representative of a patient's indi- 15 
vidual tooth and jaw structure. 

BACKGROUND OF THE INVENTION 

At present, dentists and orthodontists, when examining 
patients and keeping records of their teeth structure essen- 20 
tially operate substantially in a world of physical three and 
two dimensional records. Further, the present methods of 
operation are unduly cumbersome. A dentist or orthodontist, 
when planning a treatment for a patient, will generally 
manually produce a plaster mould which is a 3D represen- 25 
tation of the patients teeth. In addition, X-ray images are also 
used to highlight other anatomical details. The production of 
these 3D moulds is generally cumbersome and further 
results in the requirement to store the moulds handy to the 
treatment location for future examination. Further, a like 30 
treatment of medical images such as X-rays is also required. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to provide an ^ 
alternative form of keeping and utilising dental patient 
records, and allowing for the interaction there between. 

In accordance with the first aspect of the present invention 
there is provided a 3D computer graphic model of a set of 
teeth, each of the teeth being manipulable by an interactive 40 
manipulation means to accurately reflect the current position 
of a patient's set of teeth. Preferably, the placement of the 
teeth is derived from corresponding images of plaster cast 
and/or medical images of the teeth. 

Further, the computer graphic model preferably has the 45 
ability to automatically produce a sequence of images map- 
ping movements of teeth from a first position corresponding 
to the patient's current state to an idealised second position. 

Further, the model preferably includes the ability to add 
brackets to the surfaces of any tooth and to simulate the 50 
likely movements of any or all teeth under the forces 
produced by the orthodontic appliances. Additionally, 
advantageously there is provided the ability to accurately 
model likely teeth and jaw movements when bands etc, are 
utilised in conjunction with the brackets to produce regiona- 55 
Used forces acting on tooth surfaces. The preferred system 
having full interactive ability to determine the extent of 
forces by means of direct user input. Further, an alternative 
form of the invention can include the ability to measure 
sensor inputs and to input the measured sensor inputs into 60 
the 3D graphical model for providing simulated jaw move- 
ments of the model. Further, simulated sound output is also 
preferably provided, simulating or rendering the recorded or 
likely sound to be heard when the teeth are brought into 
contact with one another (dental occlusion). In accordance 65 
with a second aspect of the present invention there is 
provided a method of automatically determining cephalom- 
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etric structures in a cephalometric radiograph which can 
optionally include utilising the corresponding 3D computer 
graphic model as aforementioned to determine positions of 
cephalometric structures on an X-ray image. Preferably, the 
system allows for interactive alteration of any and all 
cephalometric structures and measures. 

In accordance with a further aspect of the present inven- 
tion there is provided a method of keeping patient dental 
records comprising: 

(a) providing a 3D model of a standard set of teeth which 
is interactively manipulable by a user; 

(b) utilising said model composited over a medical image 
corresponding to a patient's dental structure by means of 
adjusting the tooth position within said model to match said 
medical image. 

In accordance with a further aspect of the present inven- 
tion there is provided a method of creating brackets and/or 
braces for orthodontic treatment comprising: 

(a) determining an accurate individualised 3-dimensional 
computer graphical model of a patient's teeth; 

(b) utilising said model to place at least one simulated 
bracket on the surface of at least one of said teeth; 

(c) adapting said simulated bracket to the corresponding 
surface of said tooth; and 

(d) utilising said simulated bracket to produce a corre- 
sponding actual bracket for utilization in said orthodontic 
treatment. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Notwithstanding any other forms which may fall within 
the scope of the present invention, preferred forms of the 
invention will now be described, by way of example only, 
with reference to the accompanying drawings in which: 

FIG. 1 illustrates the steps of a first form of creation of an 
individualised 3D model of a patient's tooth position; 

FIG. 2 illustrates an example standard 3D tooth model; 

FIG. 3 illustrates the process of manipulation of the 
standard model in front of a corresponding X-ray image to 
derive a patient model for the tooth positions; and 

FIG. 4 illustrates a process for interpolation between a 3D 
individualised model and a 3D standard model. 

DESCRIPTION OF PREFERRED AND OTHER 
EMBODIMENTS 

In the preferred embodiment of the present invention, an 
individualised 3D model of a patient's teeth is created from 
two dimensional dataset representations and a standard 3D 
model utilising a computer system. The preferred embodi- 
ment can be implemented utilising a standard high end 
Pentium (trade mark) based personal computer system run- 
ning a high end operating system such as "Windows 
NT(Trade Marks) and a 3D modelling language modelling, 
for example, the standard virtual reality mark-up language 
(VRML). Further, a high end standard Twain compatible 
scanner should be provided, inter-connected to the 
computer, for the scanning of images. 

Referring to FIG. 1, the usual 2D plaster cast model 1 
taken from a patient is digitally rendered by placing it on a 
T\vain compatible flat bed scanner or equivalent device to 
produce a scanned 2D image of both the upper and lower 
jaws. Further, the usual side medical images 2, such as 
X-rays, are also digitally rendered into the computer system 
by scanning. 

A 3D "standard" model 3 for the patient is provided. The 
3D standard model is represented by a three dimensional 
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computer graphical representation of a standard male or 
female patient's teeth as required. It is well known in the 
field of dentistry that the structure of individual's teeth in 
respect of their size and shapes is substantially of low 
variance across a general population. However, there is a 
high variance generally with respect to position or place- 
ment of an individual's teeth. Hence, the use of the standard 
3D models is well known in clinical teaching and in practice. 
The 3D standard model can be created in a 3D computer 
graphical form as a "once off" by laser scanning a physical 
example of the corresponding 3D standard model or by other 
known techniques for entering 3-dimensional data into a 
computer system. 

Turning now to FIG. 2, there is illustrated an example 10 
of the three dimensional computerised form of the standard 
teeth model. Preferably, the 3D form includes the usual 
controls (not shown) for the location, scaling and translation 
of each of the upper and lower jaws. Also, preferably, 
controls are included for the scaling translation and rotation 
of each tooth 11 independently. Further, each tooth 11 can 
preferably be selected to be visible or invisible in accor- 
dance with a particular patient's jaw profile. Further, each 
tooth 11 can be made partially transparent. Further standard 
enhancements, such as the placement of computer graphical 
lighting sources to provide shading and other 3D enhanced 
effects which normally are of standard 3D modelling pack- 
ages can also be utilized for enhanced realism. 

Turning again to FIG. 1, in the preferred embodiment, the 
3D standard model 3 is utilised, in conjunction with the 
"scanned" plaster cast model 1 and/or a profile X-ray view 
2, to produce a 3D individualised model 4 which differs 
from the standard 3D model 3 in a patient specific manner. 
The individualised 3D model can then be utilised as a patient 
record for treatment planning and record keeping. 

The 3D individualised model can be determined from the 
standard model by many different techniques known to those 
skilled in the art of computer graphics and image processing. 
One form of manual orientation of teeth position will now be 
illustrated with reference to FIG. 4. In this case, the patient's 
X-ray image 30 is displayed on the computer screen as a 
background image for the 3D standard model. The standard 
model is then rotated, translated and scaled by the user so as 
to match the orientation of the X-ray image 30. The indi- 
vidual teeth eg. 32 are then adjusted by means of translation, 
scaling and rotation so as to match the X-ray image. 
Preferably, each tooth can be made partially transparent so 
as to enhance the alignment of the tooth 32 with the X-ray 
image. 

A similar process can then be carried out utilising the two 
dimensional scanned cast model. The cast model can be 
scanned in and displayed as a background image. The three 
dimensional computer graphic model can be overlaid over 
the cast model in jaw alignment, in a partially transparent 
form and each individual tooth adjusted so as to correctly 
place it relative to the cast model. Preferably, this process 
can be carried out for each individual upper and lower jaw 
separately with the other jaw being "turned off" via a 
suitable user interface and the tooth adjustments made. 
Although the aforementioned method of adjustment of the 
standard tooth model requires manual intervention by the 
experienced user, the utilisation of tooth models having a 
degree of transparency results in an accurate positioning of 
the computer graphic model relative to a patient's actual 
teeth position. 

Upon optimisation of the 3D individualised model, to 
teeth positions corresponding to those of the individual 


10 


20 


25 


30 


35 


40 


45 


50 


55 


60 


65 


patient, these are then saved and utilised as a computerised 
form of record for that patient. 

Other forms of fusion of the 2D moulds are possible and 
such techniques will be known to those skilled in the art of 
image analysis and 3D graphics. This further includes turn- 
ing off individual teeth as required. 

In a further refinement, the 3D individualised model can 
be utilised in treatment planning to produce an improved 
form of treatment planning. It is often the objective in 
orthodontic treatment to overcome individual anomalies in 
an individual patient's arrangement of teeth. Hence, in a 
further refinement, referring to FIG. 4, the position of an 
individual's teeth is first measured and reflected in the 3D 
model, utilizing the aforementioned techniques. The loca- 
tion and rotation of each tooth in the individualized 3D tooth 
model relative to the standard model is then noted. Next, a 
mapping from the position of each individual tooth in the 3D 
individualised model 4 to the corresponding position of the 
tooth in the 3D standard model 3 is determined by means of 
a series of interpolation steps between the two models, with 
the distance between interpolation steps being preferably a 
user defined parameter. 

The computer system is then programmed to "animate" 
the movement of teeth from the 3D individualised model 4 
to the 3D standard model through the series of steps from 
one model to the next model, rendering each step in turn for 
the specialist or patient to view. 

In a further refinement, utilizing the 3D computer model, 
accurate position sensors can be utilized to a patient's upper 
and/or lower jaws. The position sensors can be utilized to 
accurately track movement of the patient's lower jaw in 
opening and closing of the patient's mouth to define a 
motion of the lower jaw with respect to the upper jaw. This 
data can then be utilized for movement of the two jaws, one 
relative to the other. In the 3D computer graphic model, each 
jaw is treated separately and the lower jaw is then pro- 
grammed to move relative to the upper jaw in accordance 
with the pathway defined by the position sensors. Accurate 
jaw movement tracking gives the orthodontist the ability to 
accurately view a patient's likely jaw movement for each 
corresponding movement in individual tooth arrangements 
thereby locating likely problems in a patient's treatment 
program. 

In a next refinement of the preferred embodiment, a 
simulation of the sound of the 3D computer graphic model 
of the two animated jaws being drawn together is created or 
recorded. Although many refinements are possible, in one 
form, the total surface area likely to make contact between 
surfaces of the two jaws when brought together is calculated 
and an audible sound, having frequency components pref- 
erably substantially inverse to the amount of surface area 
being brought together is produced to simulate a correspond- 
ing actual sound. It will be understood by the expert in 
computer graphics that a certain degree of variation on the 
present theme is possible. For example, the definition of 
contact can be extended to a certain degree of proximity of 
two surfaces with an assumed degree of "play" in the 
surfaces being connected. Further, more accurate models are 
envisaged whereby a fourier analysis of actual teeth clench- 
ing is conducted and measurements made of the likely 
degree of contact and the profile of contact of two surfaces 
and the sound produced for those degrees of contact. Of 
course, other refinements are possible, including exaggera- 
tion of the likely sounds in order to assist the orthodontist in 
profiling the actual contact being made by any particular 
patient. Indeed, many different alterative sound formats 
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could be provided simultaneously with a selection being 
under the control of a specialist user via the usual graphical 
user interface. 

In a further refinement of the preferred embodiment, a 
means can be provided for conducting automated cephalo- 5 
metric analysis of the 2D X-ray image of the patient. In a 
first refinement, the computer graphics means can be utilised 
for display of X-ray images with various sets of cephalom- 
etric data points displayed over the X-ray image for indi- 
vidual manipulation by a user of the system. The overlays 10 
can include points of interest, connected lines, splines and 
other curves, which can be collectively manipulated to 
conduct various analyses such as Bjork, Boul ton's Triangle, 
Downs, Down Harold McNamara, Ricketts, Sterner, Tweed, 
Wits and Wylie cephalometric analysis. Preferably, a col- 15 
lection of expected landmarks for adjustment by the orth- 
odontist is initially provided in accordance with any of the 
above alternative analyses. Upon selection of the desired 
treatment, a specialist user is able to manipulate each 
individual line, spline or points placed over an X-ray image 20 
structure of the patient and thereby adjust the example set of 
lines to customise the results of the chosen analysis. The 
customised analysis is preferably able to be stored and 
retrieved as required, with each analysis being able to be 
dynamically altered as required. 25 

In a further refinement, the individualized customization 
of the points, curves and lines are automatically derived 
from the X-ray image utilising the patient's corresponding 
3D model It will be readily evident that the cephalometric 
analysis can be automatically conducted in a number of 30 
different ways, including directly locating the cephalometric 
points in the X-ray image. Alternatively, the 3D individu- 
alised model as derived in accordance with the principles 
aforementioned can be utilised to locate the cephalometric 
points and then mapped to the relevant X-ray image as 35 
located from the X-ray image of the same individual. 

In a further refinement and use of the preferred 
embodiment, the personalised 3D computer graphic model 
can be utilised for the placement of brackets and/or braces 4Q 
thereupon. Different suitable brackets can initially be cre- 
ated. The chosen bracket can be individually located inter- 
actively on the 3D model with the bracket's size, shape and 
position being adjusted by the expert orthodontist. Upon 
determination of a final position of brackets, the bracket can 45 
be individually structured to contour a corresponding sur- 
face of the tooth so as to minimise stress variance across the 
tooth or to minimise the possible damage to the tooth as a 
result of placement of each bracket but providing a better fit 
on the tooth surface. The individualised 3D model can then s 
be utilised to create an individualised bracket with accurate 
measurements with the surface of each bracket accurately 
profiled to match the corresponding surface in the individu- 
alised tooth. The bracket structure can be output in a 
standard stereo lithographic format (STL) and later used to J5 
create a corresponding customized brackets/braces. 

In a further refinement, the 3D computer graphic model 
and corresponding brackets can further include bracing rods 
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etc, each having variable tensions and forces and the 3D 
model utilised to accurately project the movement of each 
tooth under the expected structural load. Means can then be 
provided for variation in the tension of braces, bands etc, 
and, through interactive feedback, the expert user can deter- 
mine an individualised orthodontic treatment for the utili- 
sation by a particular user. 

It will be obvious to those skilled image processing and 
three dimensional computer graphics that many variations of 
the aforementioned embodiments are possible utilising the 
latest in three dimensional computer graphics techniques. 
Further, it would be appreciated by a person skilled in the art 
that numerous variations and/or modifications may be made 
to the present invention as shown in the specific embodi- 
ments without departing from the spirit or scope of the 
invention as broadly described. The present embodiments 
are, therefore, to be considered in all respects to be illus- 
trative and not restrictive. 

What is claimed is: 

1. A method of determining a dental record of a dental 
patient's teeth in a computer system comprising the steps of: 

(a) imaging a patient's teeth so as to produce at least one 
two dimensional image of the patient's teeth; 

(b) visually superimposing an initial 3 -dimensional com- 
puter graphic model of a set of teeth having indepen- 
dently manipulable teeth objects onto said two dimen- 
sional image; 

(c) interactively adjusting at least one of the position, 
orientation or scaled size of said manipulable teeth 
objects so that they are aligned with said two dimen- 
sional image; and 

(d) storing the adjusted computer graphic model of said 
set of teeth as said dental record. 

2. A method as claimed in claim 1 wherein said two 
dimensional image comprises an X-ray image of said 
patient's teeth. 

3. A method as claimed in claim 1 wherein said two 
dimensional image comprises a scanned image of a three 
dimensional impression made of a patient's teeth. 

4. A method as claimed in claim 1 wherein said 
3-dimensional computer graphic model includes an adjust- 
able degree of transparency and said step (c) further includes 
adjusting the degree of transparency of at least one of said 
manipulable teeth objects. 

5. A method as claimed in claim 1 further including the 
step of: 

(e) utilizing said dental record as an initial state in an 
iteractive series of states having different orientations 
or positions of said manipulable teeth objects. 

6. A method as claimed in claim 1 wherein said iteractive 
series of states include an initial state and a final state and 
wherein the series of states between the initial and final 
states are automatically generated. 

***** 
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